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PROGRAMMABLE MEASUREMENT MODE FOR 
A SERIAL POINT TO POINT LINK 

Background 

[0001] An embodiment of the invention is generally related to serial, 

point to point interconnect technology suitable for communicatively coupling 
elements of an electronic system, and particularly to those which have certain 
aspects that are in accordance with the PCI Express Base Specification 1.0a 
(Errata dated 7 October 2003) ('TCI Express''). Other embodiments are also 
described. 

[0002] An electronic system is composed of several elements that are 

designed to communicate with one another over an input/output (I/O) 
interconnect of the system. For instance, a modem computer system may 
include the following elements: a processor, main memory, and a system 
interface (also referred to as a system chipset). An element may include one or 
more integrated circuit (IC) devices. For example, the system chipset may have 
a memory controller hub (MCH) device that allows the processor to 
communicate with system memory and a graphics element. In addition, an 
I/O controller hub (ICH) device may be provided that connects the processor 
and memory, via the MCH, to other elements of the computer system such as 
mass storage devices and peripheral devices. In that case, a separate, point to 
point link such as one defined by PCI Express may be used to allow bi- 
directional communication between a pair of devices, e.g. the processor and the 
MCH, the MCH and the graphics element, and the ICH and the mass storage 
device. 

[0003] A PCI Express point to point link may have one or more lanes 

that can operate simultaneously. Each lane has dual, unidirectional paths, 
which are also simultaneously operable. Each path may have a single set of 
transmitter and receiver pairs (e.g., a transmitter in a port of Device A, a 
receiver in a port of Device B). In that case, the transmitter and receiver may 
drive and sense a transmission medium such as a pair of metal traces in a 
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printed wiring board that may traverse a board-to-board connector. 
Alternatively, other transmission media may be provided, such as optical fiber. 

[0004] A point to point link serves to transport various types of 

information between devices. At a so-called "higher layer", however, 
commimications between peers in two devices (also referred to as a requester 
and a completer) may be conducted using transactions. For example, there are 
memory transactions that transfer data to or from a memory-mapped location. 
Under PCI Express, there are also message transactions that communicate 
miscellaneous messages and can be used for functions like interrupt signaling, 
error signaling, and power management. 

[0005] There may be three abstract layers that "build" a transaction. The 

first layer may be the Transaction Layer, which begins the process of turning a 
request or completion data coming from a device core into a data packet for a 
transaction. The second architectural build layer is called the Data Link Layer; 
it ensures that packets going back and forth across a link are received properly 
(via techniques such as error control coding). The third layer is called the 
Physical Layer. This layer is responsible for the actual transmitting and 
receiving of the packet across the link. The Physical Layer in a given device 
interacts with its Data Link Layer (in the same device) on one side, and with 
the metal traces, optical fiber, or other transmission medium that is part of the 
link, on another side. The Physical Layer may contain circuitry for the 
transmitters and receivers, parallel to serial and serial to parallel converters, 
frequency and phase control circuits, and impedance matching circuitry. It 
may also contain circuitry for logic functions needed for its initialization and 
maintenance. A layered architecture may permit easier upgrades by, for 
example, allowing reuse of essentially the same Transaction and Data Link 
Layers, while upgrading the Physical Layer {e.g., increasing transmit and 
receive clock frequencies). 

[0006] An example of the behavior of the Physical Layer is now given. 

Once power up occurs, the Physical Layers on both Device A and Device B are 
responsible for initializing the link and making it ready for transactions. This 
initialization process may include determining how many lanes should be used 
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for the link, and at what data rate the link should operate. Sometime after the 
link is properly initialized, a memory read request is initiated in Device A. 
Eventually, a packet that includes this read request arrives at Device A's 
Physical Layer, including headers, error control information, and sequence 
numbers added by the higher layers. The Physical Layer then takes this packet 
of data and transforms it into a serial data stream (perhaps after adding 
framing data to it), and transmits the stream using, for example, an electrical, 
differential signal having predefined timing rules. 

[0007] Once the Physical Layer in Device B sees the signal appear at its 

receiver input, it samples the signal to recover the data stream, and builds the 
stream back into a data packet {e.g., after removing the framing). The packet is 
then passed up to the Data Link Layer in Device B, which strips the headers 
and checks for errors; if there are no errors, the packet is passed up to the 
Transaction Layer where the memory read request is extracted and then sent to 
the appropriate logic function to access the locations specified in the request. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0008] The embodiments of the invention are illustrated by way of 

example and not by way of limitation in the figures of the accompanying 
drawings in which like references indicate similar elements. It should be noted 
that references to "an" embodiment of the invention in this disclosure are not 
necessarily to the same embodiment, and they mean at least one. 

[0009] Fig. 1 illustrates a pair of integrated circuit devices that are 

coupled to each other via a serial point to point link. 

[0010] Fig. 2 shows a block diagram of part of the link interface circuitry 

used to implement the serial point to point link in an integrated circuit device. 

[0011] Fig. 3 depicts a flow diagram of a method for characterizing and 

ensuring the correct functionality of an analog front end to a serial point to 
point link. 
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[0012] Fig. 4A depicts a block diagram of a technique for generating test 

symbol data to be transmitted over the serial point to point link in the 
measurement mode. 

[0013] Fig. 4B shows an example running compliance pattern that is 

transmitted over a lane of the link in the measurement mode. 

[0014] Fig. 4C illustrates a corresponding inverted pattern that is 

transmitted over a different lane of the link. 

[0015] Fig. 5 shows an example state machine that may be used to 

control the generation of pattern selections for each lane of a serial point to 
point link, for operation in the measurement mode. 

[0016] Fig. 6 illustrates a block diagram of a technique for generating 

comparison test symbols, to be compared to those received over the serial point 
to point link, in the measurement mode. 

[0017] Fig. 7 illustrates a block diagram of comparison circuitry for use 

in the measurement mode. 

[0018] Fig. 8 identifies the various elements of a multi-media desktop 

personal computer some of which are communicationally coupled to each 
other via PCI Express virtual channels (VCs). 

[0019] Fig. 9 depicts a block diagram of an enterprise network. 
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DETAILED DESCRIPTION 

[0020] Various embodiments of a method and apparatus that are 

suitable for characterizing and ensuring the correct ftmctionality of the 
transmitter and receiver sections on both sides of a serial point to point link are 
described. A new mode of operation, referred to as the "compliance 
measurement/ margining" mode (CMM mode, or measurement mode) is 
defined for the link. Fig. 1 illustrates a pair of integrated circuit devices that are 
coupled to each other via a serial point to point link. The IC devices 104 
(Device A) and 108 (Device B) may be part of a computer system that contains a 
processor 112 and main memory 114. In this example, a serial point to point 
link 120 is used to communicatively couple the core of Device B with that of 
Device A. The link 120 has dual, unidirectional paths 122, with link interface 
124 that serves to interface with the device core of each respective Device A 
and B. 

[0021] In this embodiment. Device B is referred to as the root complex of 

the computer system and provides the processor 112 with I/O access to, for 
instance, a graphics element in Device A. The root complex may be partitioned 
into a graphics and memory controller hub (GMCH) and an I/O controller hub 
(ICH). The ICH would act as a further interface between the GMCH and other 
I/O devices of the system, including a non-volatile mass storage device, a 
pointing device such as a track pad or mouse, and a network interface 
controller (not shown). The point to point link 120 may be duplicated for 
communicatively coupling the Device B to the processor 112 and the main 
memory 114. Other platform architectures that feature the point to point link 
120 are also possible. 

[0022] The interface 124 of Fig. 1 may be viewed as implementing the 

multiple layer architecture (described above in the Background) for a serial 
point to point link. Some details of the interface 124 are illustrated in Fig. 2. 
The interface 124 supports independent transmit and receive paths between the 
transmission medium 122 and the Data Link Layer of its respective device 104, 
108. In the transmit path, information in the form of data packets arrive from 
the Data Link Layer and are divided into symbols that are encoded by an 

5 



Docket No.: 42P18011 
Express Mail No.: EV 339916365 US 

encode block 208. A purpose of the encoding by block 208 is to embed a clock 
signal so that a separate clock signal need not be transmitted into the 
transmission medium 122. This encoding may be the well known 8B-10B 
where an eight bit quantity is converted into a 10 bit quantity; other encoding 
schemes are possible. In some cases, such as where a separate strobe or clock 
signal is transmitted in the mediurn 122, there may be no need for such 
encoding. In addition, the symbols prior to being encoded may be scrambled 
to eliminate repetitive pattems in the subsequent bit stream and thereby help 
reduce noise generation. 

[0023] Following encoding in block 208, the units of data (referred to 

here as symbols) are processed by a parallel to serial block 212 of an analog 
front end (AFE) transmit block 214 to yield a stream of bits. Note that a "bit" as 
used here may represent more than two different states, e.g. a binary bit, a 
ternary bit, etc. The term "bit" is used merely here for convenience and is not 
intended to be limited to a binary bit. The bit stream is then driven into the 
transmission medium 122. As explained above in the Background, this 
transmission medium may be a pair of metal traces formed in a printed wiring 
board. Other forms of the transmission medium 122 may altematively be used, 
such as an optical fiber. 

[0024] The series of blocks 208-214 may serve a single lane of the point to 

point link 120 (Fig. 1). In general, there may be more than one lane in the point 
to point link 120, so that a packet received from the Data Link Layer may be 
"striped" across multiple lanes for transmission. 

[0025] Turning now to the receive side of the interface 124 shown in Fig. 

2, each lane has its associated AFE receive block 224, which serves to receive a 
stream of information from the transmission medium 122, by for example 
sampling a signal in the transmission medium 122. The AFE receive block 224 
translates between signaling of the transmission medium 122 and signaling of 
the IC device 104 (e.g., on-chip, complementary metal oxide semiconductor, 
CMOS, logic signaling). As will be explained below, the stream of information 
represents sequences of M-bit symbols (where M is an integer greater than 1) 
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that have been transmitted by the Device B over the serial point to point link 
120 (see Fig. 1). 

[0026] The stream of bits provided by the AFE receive block 224 is fed to 

symbol alignment logic 228 which serves to align or lock onto the symbols that 
have been received. In other words, and as will be explained below, the 
symbol alignment logic 228 will demarcate the correct symbol boimdaries 
within the received bit stream, for use by subsequent sections of the Physical 
Layer in the device 104. 

[0027] The symbol-aligned bit stream may then be fed to decode block 

232 which undoes the encoding performed by encode block 208 {e.g., 10B-8B 
decoding, to yield symbols of information consisting of eight binary bits each). 
In addition, any de-scrambling (if applicable) would then be performed on the 
decoded symbols. 

[0028] The decoded symbols are then fed to an elastic buffer, EB 234. 

The EB 234 serves to compensate for any differences in the tolerance of the rate 
at which the symbols were transmitted in Device B and a local clock signal 
(locaLclk) of Device A. The local_clk is used to unload symbols from the EB 
234, as well as in some cases operate parts of lane to lane deskew circuitry 238 
as explained below (in the case where the link 120 is composed of more than 
one lane). It should be noted that the decode block 232 (if provided) may be 
placed further downstream, e.g. at the output of the EB 234 or at the output of 
the deskew circuitry 238. 

[0029] A symbol may be a "data" symbol that represents some payload 

that has been sourced by the Data Link Layer, Transaction Layer or some other 
higher layer such as the device core. Alternatively, a symbol may be a "non- 
data" symbol, e.g. a special symbol generated by one of the Physical, Data Link, 
or Transaction Layers, to achieve some type of control over the information 
that is being transmitted over the serial point to point link. Several examples of 
such non-data symbols will be given below as PCI Express special symbols. 

[0030] PCI Express defines a number of special symbols that are added 

to the packets that are being communicated. For instance, special symbols may 
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be added to mark the start and stop of a packet. This is done to let the 
receiving device know where one packet starts and where it ends. Different 
special symbols are added for packets that originate in the Transaction Layer 
than in the Data Link Layer. In addition, there is a special symbol called "SKP" 
(skip) which is to be used by the Physical Layer for compensating for small 
differences in the operating data rates of two communicating ports. There is 
also a special symbol called "COM" (comma) that is to be used for lane and 
link initialization by the Physical Layer. 

[0031] Fig, 2 also shows a link training state machine (LTSM) 244. The 

LTSM 244 is a Physical Layer sub-block that is responsible for the link 
initialization process that configures and trains the constituent parts of a link so 
that normal packet traffic (from and to the Data Link Layer) can proceed 
through the link. Under PCI Express, the LTSM 244 is defined with a number 
of top-level states with each consisting of sub-states. There are link training 
states (Detect, Polling, and Configuration), link retraining (Recovery), power 
management states (LO, LI, L2/3), active power management states (LOs, LI), 
and other states (Hot Reset, External Loopback, and Disabled). The LTSM 244 
enters and exits a state, for example, depending on whether certain conditions 
in the link interface 124 are met. The LTSM 244 also controls the link interface 
124 to perform certain operations that have been defined for each state. 

[0032] Turning now to Fig, 3, Fig. 3 depicts a flow diagram of a method 

for characterizing and ensuring the correct functionality of an analog front end 
of a serial point to point link. The method may be performed in a system or 
platform that has an IC device (such as Device A, see Fig. 1) with a link 
interface as described above and that has been enhanced with measurement 
circuitry (details of which will be described below). The system also has a host 
{e.g., the processor 112 in Fig. 1, or another device such as a platform 
management imit, not shown) that may program Device A as described below. 
The method begins with initializing the serial point to point link which couples 
Device A to another IC device, such as Device B (block 304). This initialization 
may occur after a power on reset has been applied to Device A and Device B. 
The initialization may involve transferring a training sequence of symbols over 
the link, as well as determining how many lanes are available for operation in 
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the link. For a PCI Express embodiment, the initiaUzing may follow a 
fundamental reset, or it may follow a hot reset. Following a hot reset, the 
LTSM 244 (Fig. 2) may enter the Detect state, to start a link training process. 
This initialization process may be automatically started without any software 
involvement, after reset. 

[0033] The following may be configured during the link initialization 

process: link width (including determining the number of lanes), lane reversal 
(for a multi-lane port that has differential signaling), polarity inversion (which 
may be needed if the differential pair terminals for the two IC devices are not 
connected correctly or have been intentionally reversed), link data rate, bit lock, 
symbol lock, and lane to lane deskew. The training sequences used during 
initialization may, as provided under PCI Express, be the physical layer 
packets referred to as Ordered-Sets. 

[0034] To place the link in measurement mode (CMM mode), a start bit 

in a register of Device A, is programmed (block 308). This may be done after 
Device A has indicated that the link is ready for normal operation (including a 
determined number of lanes). Thus, one or more bits may be designated in a 
given register of Device A to be programmable (under host or software control, 
which may or may not be manually requested by a user of the system). The 
one or more start bits are to indicate to the measurement circuitry that the link 
is to now be placed in a measurement mode that is designed to characterize 
and ensure the correct functionality of the transmitters and receivers on one or 
both sides of the link. In addition, the measurement mode may also be 
designed with the ability to determine a margin of operation of the AFE 
transmit and receive blocks (see Fig. 2). 

[0035] In the CMM mode, the Device A may instruct Device B (see Fig. 

1) to enter a loopback mode for the link. In this mode, the Device B loops the 
symbols that have been received back over the same link. While Device A 
transmits a sequence of test symbols over the link, it may then evaluate a 
looped back version of the sequence for errors (block 312). 

[0036] According to an embodiment of the invention, the transmitted 

sequence of test symbols have a data pattern as configured by one or more 
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software programmable registers of Device A, In addition, the link transmitter 
may also be configured with certain signaling formats. Accordingly, the 
process contemplates a further operation of programming these registers of 
Device A (i) to set a test symbol data pattern and (ii) one of the following 
example link settings: autoinvert, default for an inverted lane, inversion, and 
initial disparity. These signaling aspects may be as defined under PCI Express. 

[0037] In the PCI Express embodiment, the CMM mode is in addition to 

the training state referred to under PCI Express as Polling-Compliance. In the 
Polling'Compliance state, the transmitters of an IC device repeat a data pattern 
that is referred to as a compliance pattern, but the receivers in the IC device are 
essentially ignored for all but the detection of a unanimous exit (of all lanes) 
from electrical idle. According to an embodiment of the invention, the CMM 
mode may be a proprietary extension of Polling-Compliance. Note that in 
CMM mode, the receive path is active such that comparisons are performed on 
the symbols received in each lane, to evaluate the pattern of the symbols that 
have been received for any errors. This additional mode allows the IC device 
and in particular its link interface to be user configurable (or also referred to as 
"run-time programmable") to better characterize and ensure the correct 
functionality of the link interface: 

[0038] To implement CMM mode, a comparator may be provided on 

each lane of the link. The comparator evaluates whether the pattern of symbols 
that have been received over a given lane match those that have been 
transmitted on that same lane. For this to be possible another IC device (such 
as Device B), which can be trained up to the PCI Express Loopback.Active 
state, for example, may be attached to the link. The device initiating CMM may 
be referred to as a loopback master or a CMM master, and the other device is a 
loopback slave or CMM slave. The following paragraphs describe some 
aspects of operation in CMM mode. 

CMM Start 

[0039] CMM mode may be initiated from the PCI Express LO state of the 

CMM master, by writing a 1 to the CMM Start bit of a software-programmable 
register in the CMM master. In response, the following may take place: 
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[0040] The CMM master sends a training sequence such as a special 

loopback bit being set in a control byte of a TSl Ordered-Set. This action trains 
the CMM slave into the PCI Express Loopback.Active. In addition, a SKP 
Ordered Set may then be transmitted on each lane of the link, followed by the 
transmission of a compliance pattern that may be repeated on each lane. VVhen 
the SKP Ordered Set has looped back to a lane's receiver in the CMM master, 
that lane is deemed synchronized with its transmitter, so that the link interface 
may begin comparing each received symbol to determine any errors. 

[0041] If any lane detects a miscompare or error, a CMM Error Detected 

status bit (in a software-accessible register, for example) is set. Meanwhile, 
other CMM registers capture the failing lane number and failing data pattern, 

[0042] According to an embodiment of the invention, the link training 

state machine (LTSM) 244 of the link interface 124 (Figs. 1-2) in the CMM 
master is provided with an additional flag that, when set, qualifies the PCI 
Express Polling-Compliance state into CMM mode (which enables the 
additional behavior as described here). This allows the CMM master to remain 
compatible with the base PCI Express states. 

CMM Fail Detect 

[0043] When an error is detected, the error bits, error lane and error data 

logging registers may be locked out from further updates, although the 
transmitters continue to cycle through the compliance pattern. For example, 
only the first failure may be logged - if two or more lanes fail simultaneously, 
the higher numbered lane may be the one that is logged. The failing lane may 
be determined by software reading a CMM Failing Lane Number register. A 
failing data pattern may need several status registers, depending on its size. 

[0044] If the failing lane does not match one of the lanes indicated in a 

CMM Invert register, or if inversion is disabled, then the failing pattern is 
placed in a data register indicated by a CMM Symbol Error Number register. 
Otherwise, the failing pattern may be assumed to be an inverted one, and is 
placed in the data register indicated by the CMM Symbol Error Number Invert 
register. 
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[0045] Another type of failure may occur when the CMM master is 

unable to successfully train into CMM mode. Software may detect such a 
condition by polling a Training Timeout status register. A flag in this register 
will be set after the timeout of whatever training state that failed. As an 
alternative, software may poll a Link Status register at least every 0.5us, for 
example, after setting the CMM Start bit; if this status is ever observed to 
transition from Detect (0000) to any other state and back to Detect over a 
predefined period of time {e.g., 20us in fast-training or 80ms in normal 
training), then it may assume that CMM mode was never entered. 

CMM Exit 

[0046] CMM mode may be exited by writing a 0 to the CMM Start bit. 

The CMM master may then initiate an exit from loopback and then move to the 
PCI Express Detect state to do a full retrain back to LO state. Normal operation 
may then resume from the LO state. In contrast, the PCI Express 
Polling-Compliance mode is only exited if all of the lanes that detected the 
presence of a receiver (at the other end of the link) now have detected an exit 
from a PCI Express Electrical Idle condition. 

CMM Configurability 

[0047] Operation of the link in the CMM mode may be configured by 

programming a number of registers, to configure the transmitters of one or 
more lanes in the link. In one embodiment, all changes to the CMM 
configuration are done prior to writing the CMM Start bit, and may not 
changed while the Start bit remains set. The CMM capabilities include: 

[0048] Changing the data pattern. By writing to the CMM Data registers 

and the CMM Data Select registers, different transmit symbol patterns may be 
generated. The CMM Data Select registers may also determine if the 
corresponding CMM Data register will be 8b /I Ob encoded, as a data character 
or as a special symbol. 

[0049] Disabling autoinvert. If a 0 is written to the CMM Autoinvert bit, 

the lanes which see the inverted pattern will not sequence to the next lane, but 
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rather will remain on lane 0 and 8 as per the default initial condition under PCI 
Express. 

[0050] Changing the default inverted lanes. By setting the value of 

CMM Invert Lane Number, a different initial set of lanes can be set for 
inversion. When combined with disabling autoinvert, the inversion pattern 
may be observed to remain on the specified lanes. 

[0051] Disabling inversion. If a 0 is written to CMM Invert, no lanes will 

be inverted regardless of what is contained in any of the other registers. 

[0052] Changing the initial disparity. The CMM Initial Disparity register 

sets the disparity of the first transmitted symbol of a CMM pattern. The 
8b /10b encoder in the transmit path may determine the disparity of the rest of 
the transmit symbols 

[0053] Additional advantages may be obtained by operation in CMM 

mode, with the following user-configurable settings: 

[0054] Transmitter load strobe margining. To measure a margin of 

operation of a transmitter load strobe in the linlc, the CMM master may be 
placed into CMM mode with a default load strobe position. The load strobe 
position may then be changed, i.e. advanced or delayed, prior to re-entering 
CMM mode. Since the transmitter load strobe may not be synchronized into 
the destination clock domain (of the CMM slave), there may be a one symbol 
error injected, even on Icnown good strobe settings. Accordingly, upon setting 
a load strobe, the CMM Error bit should be written to clear a possible first 
symbol glitch. Subsequent values of the CMM Error bit may be trusted. The 
load strobe may also be shmooed by writing a new load strobe value, clearing 
the CMM Error bit, and then testing the CMM Error bit, and repeating. 

[0055] Receiver Common Mode Voltage (Vcm) margining. According to 

another embodiment of the invention, the AFE receive block (see Fig. 2) may be 
designed to have variable Vcm. Note that a new Vcm setting may require that 
a certain settling time be considered, which makes such an AFE adjustment 
similar to the load strobe case. In other words, after entering CMM mode, the 
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CMM Error bit should initially be cleared before evaluating the CMM Error bit 
for the effect of the changed Vcm. 

[0056] Data Recovery Circuit (DRC) margining. A margin of operation 

of the Data Recovery Circuit (DRC) in the AFE receive block may be 
determined as follows. First, initiate CMM. Then, write to an mcount offset 
register to change the position of data sampling. Since these registers are clock 
crossed into the appropriate domain in the DRC, mcount offset can be shmooed 
with successive register writes and CMM Error bit evaluations. 

[0057] Jitter Margining (Jitterbug). The tolerance of the AFE to jitter may 

be measured as follows. First, initiate CMM. Then, write one or more 
configuration registers with a step size, wait state, etc. to select the desired jitter 
parameters. Then write the enable bit to start jitter injection. The enable bit 
may be the only synchronized input to jitterbug logic (not shown) and should 
be executed as a final solitary register write. Next, evaluate the CMM Error bit. 
To shmoo over numerous settings, set up a new set of jitter parameters, write 
the enable bit, clear the CMM Error bit and then evaluate the CMM Error bit. 

Example Circuitry for Transmitter Data Generation 

[0058] According to an embodiment of the invention, and as illustrated 

in Fig. 4A, two compliance pattern generating state machines PI SM and P2 SM 
may be provided in the link interface 124 (see Fig. 1). These pattern generators 
may be started on two different conditions. In one case, the generators are 
started when the Link Training State Machine (LTSM) 244 (Fig. 2) enters the 
PCI Express Polling-Compliance state. In another, the generators start when 
the CMM Start bit is set, the LTSM has entered the LO state/and an SKP 
Ordered Set sequence has been launched to the CMM slave. Note that in the 
Polling-Compliance mode, both the scrambler and de-scrambler (if provided) 
are disabled. In the CMM mode, however, a Scrambler Enable configuration 
register bit may determine if the scrambler /de-scrambler is enabled or 
bypassed. 

[0059] Once started, each state machine PI SM, P2 SM may generate the 

sequence of symbols stored in data registers CMM D3, D2, Dl, and DO. Four 
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additional configuration bits, CMM Sym3, Sym2, Syml, and SymO may be 
provided to determine if each data register contains a data symbol or a control 
(non-data) symbol. Still referring to Fig. 4A, PI SM generates the compliance 
pattern {CMM DO, CMM Dl, CMM D2, CMM D3} on complpatternl[8:0] where 
bit #8 denotes the control/ data information. The default symbol pattern for 
the PI SM may be {K28.5, D21.5, K28.5, D10.2} as defined under PCI Express, 
which can be re-programmed. The initial disparity is also programmable via a 
configuration register bit, but it may be defaulted to 0. As to the Pattern 
generator P2 SM, it may generate the inverse of the pattern generated by the PI 
SM, on complpattern2[8:0] where again bit #8 denotes the control /data 
information. 

[0060] A running compliance pattern for the default example, by the PI 

SM, is shown in Fig. 4B. The start conditions, as described previously, 
initialize the running disparity to 0. The corresponding running compliance 
pattern for the P2 SM is shown in Fig. 4C. Note how the inverted lanes are just 
delayed with respect to the noninverted lanes, by inserting in this case two DO 
(default K28.5) symbols before the compliance sequence (D0-D3). These 
characters will leave the running disparity back at 0, before starting into the 
compliance sequence. The net effect is that the adjacent lanes will be inverted 
from the delayed lane. 

[0061] The Invert Lane Select (ILS) state machine (SM), ILS SM 504, 

shown in Fig. 5 generates pattern selects for each lane. In CMM mode, each 
lane may be transmitting from either the PI SM or the P2 SM (Fig. 4A) 
according to the selects generated by the ILS SM 504. If CMM Invert Enable is 
asserted, no inversion will happen on any lanes and the PI SM will be 
transmitting on all lanes. If, during evaluation of the looped back symbols, an 
error occurs, the state of the ILS SM 504 is stored in a CMM Invert register 508. 
Fig. 5 shows the ILS SM 504 having an example nine states (Idle and states 0-7) 
represented by a four bit output. Each state specifies a different 16-bit 
compliance pattern pattcmpsel[15:0]. Transitions between states are governed 
by conditions A-H as they are found in the programmable registers CMM 
Invert Enable and CMM Invert Lane Number. Other implementations of the 
above-described lane inversion capability in CMM mode are possible. 
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Example Receiver Comparison Circuitry 

[0062] According to an embodiment of the invention, the looped back 

symbols may be evaluated by generating compare patterns using essentially 
duplicates of the transmit state machines (see Fig. 4A). These are PIC SM and 
P2C SM as shown in Fig. 6. One difference between the transmit and compare 
versions of the state machines may be the start condition. For the compare data 
state machines, the start condition may be: the CMM Start bit being set and the 
LTSM has entered the LO state and a SKP sequence has been received (looped 
back). Note that in CMM mode, the SKPs may be suppressed after the launch 
of the first SKP sequence upon entering LO. 

[0063] When a comparison error has been detected (cmmerrdet is 

asserted), the states of both compare state machines PIC SM and P2C SM are 
stored in the registers CMM Error Number (cmmsymerrnum[l:0]) and CMM 
Error Number Inv (cmmsymerrnuminv[2:0]), respectively, for later readout by 
a host in the system. 

[0064] By syncing on the reception of the SKP, the compare pattern 

generators PIC SM and P2C SM will match the incoming data on each lane. 
An example logic diagram of the comparison logic is shown in Fig. 7, where a 
per lane comparison is done on the generated compare pattern versus the 
received data, and the results are OR'd to produce an error bit stored in CMM 
Error Detect (cmmerrdet is asserted). A priority encoder will encode the 
highest order failing lane number and store it in CMM Error Lane Number 
(indicated by cmmerrlnnum[3:0]). The CMM Error Detect register bit may be 
polled by the host, to report that a failure has occurred. If a failure occurs, the 
expected data can be reconstructed from the CMM Error Lane Number, CMM 
Invert, CMM Error Number, and CMM Error Number Invert register bits. 
CMM Error Lane Number indicates the failing lane, while CMM Invert 
indicates if the lane was inverted or not. Based on the invert state, either the 
CMM Error Number or CMM Error Number Invert register indicates which 
data register was being compared. Other logic designs for this comparison 
capability are also possible. 
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[0065] When an error is detected as described above (cmmerrdet 

asserted), the CMM Error Lane Number, CMM Invert, CMM Error Number, 
and CMM Error Number Invert register bits may be locked. No additional 
errors may be logged in that case. The host should then read those bits. To 
reset the CMM mode thereafter, the IC device may be designed to go through a 
hard reset. 

[0066] The above-described link interface circuitry and methodology 

may also be implemented in IC devices that are designed to communicate via a 
serial, point to point interconnect technology that provides isochronous 
support for multimedia. Isochronous support is a specific type of QoS (Quality 
of Service) guarantee that data is delivered using a deterministic and time- 
dependent method. Platform-based isochronous support relies on a 
documented system design methodology that allows an application that 
requires a constant or dedicated level of access to system resources to gain the 
required bandwidth at a given time interval. 

[0067] An example is that of watching an employee broadcast that 

originates from the company's CEO, on a desktop while working on a report, 
as shown in Fig. 8. Data is routed from the intranet into the desktop main 
memory where the application utilizes the data to create an audio stream sent 
to the user's headphones via an add-in card and a video stream sent to the 
display via a graphics controller. If simultaneous operations are occurring 
within the desktop personal computer (PC), such as disk reads, data coming off 
the Internet, word processing, email, and so on, there is no guarantee that the 
audio and video stream will be truly glitchless. Data is delivered on a "best 
effort" method only. The user may experience skips or stalls as applications 
compete for the same resources. Isochrony in PCI Express solves this problem 
by establishing a mechanism to guarantee that time-sensitive applications are 
able to secure adequate system resources. For example, in Fig. 8, the video 
time-sensitive data would be guaranteed adequate bandwidth to prevent skips 
at the expense of non-critical data such as email. 

[0068] The above-described link interface circuitry and methodology 

may also be implemented in IC devices that are designed to communicate via a 
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serial point to point link technology that is used in communications equipment, 
from embedded applications to chassis-based switching systems. In advanced 
switching, mechanisms are provided to send packets peer-to-peer through the 
switch fabric. These markets also benefit from the server class hardware-based 
error detection that is available with PCI Express. There may be two main 
types of usages within communications equipment, control plane processing 
and data plane processing. Control plane refers to the control and 
configuration of the system. The serial link may be used as the interface to 
configure and control processors and cards within a large number of systems. 
Chassis-based building switches typically have various cards that can be 
inserted and used. Chassis-based switches may offer field-upgradeability. 
Most switching systems offer the ability to only populate half of the chassis 
initially and add cards with additional ports or faster speed connections as 
demand or the number of users increase. The serial link technology could be 
used as a control plane interconnect to configure and monitor the different 
types of cards installed within the system. The enumeration and established 
configuration protocol within PCI Express, for example, lends itself to a low 
pin count, high bandwidth interface to configure cards and services. 

[0069] The data plane refers to the actual path that the data flows. In the 

data plane, an advanced switching extension may define mechanisms to 
encapsulate and send PCI Express data packets across peer-to-peer links 
through the switch fabric. 

[0070] The PCI Express core architecture may provide a solid foundation 

for meeting new interconnect needs. The Advanced Switching (AS) 
architecture overlays on this core and establishes an efficient, scalable, and 
extensible switch fabric through the use of a specific AS header inserted in 
front of the PCI Express data packet at the Transaction Layer. AS switches only 
examine the contents of the header that provide routing information (where to 
send the packet), traffic class ID (quality of service information), congestion 
avoidance (for preventing traffic jams), packet size, and protocol encapsulation. 
By separating the routing information, switch designs are simpler and cost- 
effective. Additionally, adding an external header to the packet enables the 
switch fabric to encapsulate any number of existing protocols. 
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[0071] The above-described link interface circuitry and methodology 

may also be implemented in IC devices that are designed to communicate via a 
serial point to point interconnect technology that is used for network 
connections (in place of Gigabit Ethernet, for example). The network 
connection may be for corporate mobile and desktop computers for sharing 
files, sending emails, and browsing the Internet. Servers as well as 
communications equipment may be expected to implement such network 
connections. An example of such a network cormection within the enterprise 
network is shown in Fig. 9. 

[0072] Although the above examples may describe embodiments of the 

invention in the context of combinational and sequential logic circuits, other 
embodiments of the invention can be implemented by way of software. For 
example, some embodiments, may be provided as a computer program 
product or software which may include a machine or computer-readable 
medium having stored thereon instructions which may be used to program a 
computer (or other electronic devices) to perform a process according to an 
embodiment of the invention. In other embodiments, operations might be 
performed by specific hardware components that contain microcode, 
hardwired logic, or by any combination of programmed computer components 
and custom hardware components. 

[0073] Further, a design may go through various stages, from creation to 

simulation to fabrication. Data representing a design may represent the design 
in a number of manners. First, as is useful in simulations, the hardware may be 
represented using a hardware description language or another functional 
description language. Additionally, a circuit level model with logic and/or 
transistor gates may be produced at some stages of the design process. 
Furthermore, most designs, at some stage, reach a level of data representing the 
physical placement of various devices in the hardware model. In the case 
where conventional semiconductor fabrication techniques are used, data 
representing a hardware model may be the data specifying the presence or 
absence of various features on different mask layers for masks used to produce 
the integrated circuit. In any representation of the design, the data may be 
stored in any form of a machine-readable medium. An optical or electrical 
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wave modulated or otherwise generated to transmit such information, a 
memory, or a magnetic or optical storage such as a disc may be the machine 
readable medium. Any of these mediums may "carry" or "indicate" the design 
or software information. When an electrical carrier wave indicating or carrying 
the code or design is transmitted, to the extent that copying, buffering, or re- 
transmission of the electrical signal is performed, a new copy is made. Thus, a 
communication provider or a network provider may make copies of an article 
(a carrier wave) that features an embodiment of the invention. 

[0074] To summarize, various embodiments of a compliance 

measurement /margining (CMM) mode for testing a serial point to point link 
have been described. In the foregoing specification, the invention has been 
described with reference to specific embodiments thereof. It will, however, be 
evident that various modifications and changes may be made thereto without 
departing from the broader spirit and scope of the embodiments of the 
invention as set forth in the appended claims. For example, although a system 
embodiment has been described using the serial point to point link as a chip to 
chip connection between two devices on a printed wiring board such as in a 
desktop, server, or notebook computer, the CMM technique may also be used 
with serial point to point links that are part of an external bus for connecting 
the computer to a peripheral such as a keyboard, monitor, external mass 
storage device, or camera. The point to point link may be used in not only 
computer systems, but also dedicated communications products such as mobile 
phone units, telecommunication switches, and data network routers. The 
specification and drawings are, accordingly, to be regarded in an illustrative 
rather than a restrictive sense. 
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